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Lean  Six  Sigma  EMS  Auditing 
Improvement  Project  Summary 


•  Focus  of  project 

-  Improve  Quality  of  EMS  Audit  by... 

--  Including  environmental  regulatory  identification  w/ 
--  ISO  14001  nonconformance  citation 

•  Project  Scope:  All  JMC  installations 

•  Where  are  we  feeling  the  pain? 

-  Under-reported  total  environmental  liabilities  causing. 
-  Notice  of  Violation  (NOV)  Potential 

•  Management  audit  observations  categorizing... 

Improved  liability  prioritization 
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Problem:  JMC  Environmental  Management  System  (EMS)  ISO  14001 
management  conformance  audit  observations  do  not  always  include 
environmental  regulatory  standards  that  would  have  improved  relational 
connection  to  potential  Notices  of  Violation. 

Goals: 

Metric  #1 :  Fifty  percent  (50%)  of  audit  observations  must  cite 
environmental  regulatory  standard  ,  “best  management  practice”  or  cite 
as  a  safety/I  H/P2 

Metric#  2:  Increase  Sigma  Quality  Level  (SQL)  significantly 
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Improve  Phase  Summary 


Solution  Selection 


Using  Nominal  Group 
Technique 

We  determined  the 
following  solutions  (three 
voted  best  cited  in  red):  [ 


1.  Audit  findings  w/ 
compliance  regulation  cited 
(best) 

2.  Improve  SOW 

3.  Audit  follow-up 

4.  Provide  adequate  auditor 

training 

5.  Improve  communication 

6.  Provide  compliance 

protocols  on  computers 

7.  Provide  additional 

compliance  personnel 

8.  Ensure  compliance 

auditor  certification 
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Improve  Phase  Summary  (cont.) 
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Prepare  report 


Follow  up  audit  (by 
HQ  JMC 
Environmental 
Team)  to  ensure 
each  observation 
has  an  ISO  14001 
conformance  and 
environmental 
compliance 
regulation,  BMP,  or 
“safety/I  H/P2” 
cited  m- 


MSA  Control  Charts 
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Summary  Statistics 
Baseline  vs.  Improved 


Summary  for  No  Compliance  Citations 


HBaseline 


95%  Confidence  Intervals 


feddn 


Anderson-Darling  Normality  Test 
A-Squared  0.75 

— 

f  Mean 

30.545 

(  StDev 

20.037  J 

\^ariance 

401.473  ^/ 

SkewnKs — 

- 1  ,oo!i43 

Kuttosis 

4.21213 

N 

11 

Minimum 

12.000 

1st  Quartile 

14.000 

Median 

27.000 

3rd  Quartile 

36.000 

Maximum 

32.000 

35%  Confidence  Interval  For  Mean 

17.085 

44.006 

35%  Confidence  Interval  For  Median 

14.000 

36.304 

35%  Confidence  Interval  For  StDev 

14.000 

35.163 

Summary  for  No  Compliance  Citations 


Improved 
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Anderson-Darling  Normality  Test 

A-Squaned 

0,65 

P- Value  n.066 

Mean 

10,031 

StDev 

6.316 

Variance 

33.331 

Skewness 

1.10614 

Kurtosis 

0,27472 

N 

11 

Minimum 

3,000 

1st  Quartile 

5.000 

Median 

3.000 

3rd  Quartile 

12,000 

Maximum 

22.000 

35%  Confidence  Interval  For  Mean 

5,348 

14.334 

35%  Confidence  Interval  for  Median 

5,000 

12,740 

35%  Confidence  Interval  for  StDev 

4,413 

11,034 

5jQ 


75 


iu.G 


1 25 


15jG 


The  Lean  Six  Sigma  challenge  is  to  shift  the  mean  and/  or  reduce  variation. 
Our  baseline  mean  (30.5)  and  standard  deviation  (20.0)  shifted  to  mean  10.1 
and  standard  deviation  6.3  with  variance  from  401.5  to  39.9  showing 
improvement. 
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Summary  Statistics 
Baseline  vs.  Imoroved 


Strict  Attempt  Defects  (EMS 

Installation 

Reg  Stated  Attempts 

Defects  Good 

Installation 

Reg  Stated  ! 

Safety  P2 

IH 

BMP 

EMS  s 

only) 

Good 

HSAAP 

0 

24 

24 

0 

HSAAP 

3 

4 

2 

0 

8  7 

24 

7 

17 

LCAAP 

1 

15 

14 

1 

LCAAP 

4 

7 

0 

0 

1  3 

15 

3 

12 

MCAAP 

1 

28 

27 

1 

MCAAP 

12 

5 

1 

0 

5  5 

28 

5 

23 

PBA 

0 

32 

32 

0 

PBA 

7 

13 

0 

0 

0  12 

32 

12 

20 

HWAD 

0 

47 

47 

0 

HWAD 

16 

7 

1 

0 

12  9 

45 

9 

36 

CAAA 

0 

36 

36 

0 

CAAA 

14 

7 

1 

0 

5  9 

36 

9 

27 

IAAAP 

0 

12 

12 

0 

IAAAP 

0 

0 

0 

0 

0  12 

12 

12 
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RFAAP 

0 

14 

14 

0 

RFAAP 

5 

2 

0 

0 

2  5 

14 

5 
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TEAD 

0 

20 

20 

0 

TEAD 

2 

6 

0 

0 

6  6 

20 

6 

14 

MLAAP 

0 

28 

28 

0 

MLAAP 

6 

0 

0 

0 

1  21 

28 

21 

7 

BGAD 

0 

82 

82 

0 

BGAD 

20 

23 

4 

0 

9  22 

78 

22 

56 

Totals 

2 

338 

336 

2 

Totals 

89 

74 

9 

0 

49  111 

332 

111 

221 

The  Sigma  Quality  Level  (SQL) 

for  our  baseline  was  336/338  x  1 ,000,000 

= 

994,083  DPMO,  SQL  <  0.1.  The  SQL  after  process  improvements  was  111/332 
x  1,000,000  =  334,337  DPMO,  SQL  >  1.9;  showing  improvement. 
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Process  Capability 
Baseline  vs.  Improve' 


Binomial  Process  Capability  Analysis  of  No  Compliance  Citations 


P  Chart 


Baseline 


Tests  performed  with  unequal  sample  sizes 

Cumulative  %No  Compliance  Citations 


Summary  Stats 
(95.0%  confidence) 

%No  Compliance  Citations:  93,33 

bower  Cl:  96,39 

Upper  Cl:  99.42 

Target:  50,00 

PPM  DeF:  933300 

bower  Cl:  962949 

Upper  Cl:  994153 

Process  Z:  -2.1272 

bower  Cl:  -2.5212 

Upper  Cl:  -1.7360 


Histogram 

Tar 


%No  Compliance  Citations 


Binomial  Process  Capability  Analysis  of  No  Compliance  Citations 

Yl 

§  Rate  of  No  Compliance  Citations 


P  Chart 


UCb=0,495 
P=0 ,334 
bCb=0,174 


Sample 

Tests  performed  with  unequal  sample  sizes 

Cumulative  %  No  Compliance  Citations 


Improved 


Summary  Stats 

(95,0%  confidence) 

%No  Compliance  Citations: 

33.43 

bower  Cl: 

23.33 

Upper  Cl: 

33.79 

Target: 

50.00 

PPM  Def: 

334337 

bower  Cl: 

233765 

Upper  Cl: 

337397 

Process  1\ 

0,4230 

bower  Cl: 

0,2343 

Upper  Cl: 

0,5717 

Histogram 

Tar 


%  No  Compliance  Citations 


Met  customer  goal  for  <  50%  no  compliance  citations  (actual  -33%  no 
compliance  citations)  through  improvements  to  observations.  Two-thirds  (2/3)  of 
audit  observations  now  classified  and  validated  to  environmental  compliance 
standards,  identified  as  safety/  industrial  hygiene,  pollution  prevention,  or  BMPs. 
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Type  III:  More  frequent  up-to-date  information  on  environmental 
compliance  requirements  providing: 

•  Better  awareness, 

•  Funding  visibility  and  prioritization,  and 

•  Fix  environmental  problems  prior  to  regulatory  detection  as 
an  NOV. 

•  The  SQL  for  the  process  was  increased  from  <  0.1  to  >  1 .9 
SQL. 


Ready  -  Reliable  -  Lethal 


UNCLASSIFIED 


1 .  Difficult  to  pinpoint  only  one  applicable  regulation  for  an  audit  observation. 


2.  Safety  and  industrial  hygiene  observations  should  mention  the  appropriate 
regulatory  exception 

3.  The  ISO  14001  areas  of  legal  requirements,  operational  control,  and  document 
control  have  the  highest  frequency  regulatory  noncompliance. 

4.  Always  more  appropriate  to  follow  a  regulatory  compliance  audit  with  an  ISO 
14001  audit,  so  the  efficiency  and  effectiveness  of  an  installation’s  Environmental 
Management  System  can  be  properly  evaluated. 

5.  Always  some  “defectives”  (no  compliance  citations)  during  an  ISO  14001  audit 
since  some  ISO  14001  non-conformances  under  the  ISO  14001  standard  have 
no  regulatory  compliance  parallel  or  standard. 

6.  Auditing  environmental  professionals  must  be  well  versed  in  both  the  ISO  14001 
standard  and  environmental  regulatory  standards  and  have  experience  and 
education  in  performing  environmental  auditing. 
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